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SOME PROPERTIES OF THE COMMUNALITY IN 
MULTIPLE FACTOR THEORY 


MERRILL ROFF* 


Indiana University, Bloomington, Indiana 


*The author wishes to express his appreciation of the encouragement and 
assistance given him by Dr. L. L. Thurstone. 


Several theorems concerning properties of the communaltiy of a 
test in the Thurstone multiple factor theory are established. The 
following theorems are applicable to a battery of n tests which are 
describable in terms of r common factors, with orthogonal reference 
vectors. 

1. The communality of a test 7 is equal to the square of the 
multiple correlation of test 7 with the r reference vectors. 

The communality of a test 7 is equal to the square of the 
multiple correlation of test 7 with the r reference vectors and the 
n—1 remaining tests. 

Corollary: The square of the multiple correlation of a test 7 
with the n—1 remaining tests is equal to or less than the communal- 
ity of test 7. It cannot exceed the communality. 

38. The square of the multiple correlation of a test j with the 
n—1 remaining tests equals the communality of test j if the group 
of tests contains 7 statistically independent tests each with a com- 
munality of unity. 

4. With correlation coefficients corrected for attenuation, when 
the number of tests increases indefinitely while the rank of the 
correlational matrix remains unchanged, the communality of a test 
j equals the square of the multiple correlation of test 7 with the n—1 
remaining tests. 

With raw correlation coefficients, it is shown in a special 
case that the square of the multiple correlation of a test 7 with the 
n—1 remaining tests approaches the communality of test 7 as a lim- 
it when the number of tests increases indefinitely while the rank of 
correlational matrix remains the same. This has not yet been proved 
for the general case. 


In the multiple factor theory of Professor L. L. Thurstone (2) 
the concept of communality has a prominent place. The communality 
of a test is defined as its common factor variance, or “that part of 
its variance which is due to factors common to other tests in the bat- 
tery” (2, pp. 62-63). When standard scores are used, the total variance 
of a test can be expressed as follows (2, pp. 55,57): 


Saint + b)?+o6/7%=1, 
in which 
m refers to the common factors, .« 
j refers to tests, 
r = the number of common factors, 
‘citiinn 
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jm = the loading of the common factor m in test 7, 
b;; = the loading of the specific factor of test 7 in test 7, 
c;; = the loading of the error factor of test 7 in test 7. 


The following terms have also been defined (2, p. 63): 
> Qjm? = h;? = communality of test 7 , 
m=1 


b;;? + ¢;;? = u;? = uniqueness of test j , 
so that 
hf+ur=1. 


In factoring a correlation matrix it is desirable to use the com- 
munality, h;?, of each test as the diagonal entry for that test in the 
reduced correlational matrix. However, h;? can be determined only 
after the factorization has been completed. Consequently, it is neces- 
sary to estimate the communality before the analysis begins, and sev- 
eral methods of estimation have been discussed by Thurstone (2, pp. 
85-91). Beyond this practical problem arises the theoretical problem 
of the characteristics and significance of this important concept, 
which is not yet completely solved. 

The present paper describes several properties of the communal- 
ity, and relates the factor methods to the older technique of multiple 
correlation. A new method of estimating the communality of a test 
is indicated, but whether or not this method will prove better than 
those now in use remains to be seen. The following theorems are 
applicable to a battery of n tests which are describable in terms of 
r common factors, with orthogonal reference vectors. Since the com- 
munality of all tests in a battery must remain invariant under rota- 
tion, the theorems which follow are quite independent of any spe- 
cific position of the reference vectors. 

1. The communality of a test 7 is equal to the square of the 
multiple correlation of test 7 with the r orthogonal reference vectors. 
That is, 

hf? = it Pr 
where 
1? ;.323 «-. , == the square of the multiple correlation between a test 
j and the r reference vectors. 


Here when r is used as a correlation coefficient, it will always be ac- 
companied by subscripts; when r occurs without subscripts, it will 
always refer to the rank of the matrix. 

The loading of the common factor m in test j, ajm, may be rep- 
resented geometrically as the projection of the vector of test 7 on the 
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reference vector of m; it may also be regarded as the correlation be- 
tween test 7 and the reference vector of m; then 

Aim =T jim - 


The multiple correlation coefficient, 7;..;...,, is given by the 
well-known formula, 





2 
Tjorag coo gh W1 — 0? j0123 22 of 
where 
2. ee eee 4 2. 
CO je123 © 6 er Oj, COj2-1 0 0 oD jre123 * © © (r-1) 


= (1— 1.7) (1—1%4joe1?) --+ (1 — 22 jreizs « «+ (r-2)) 


where o with appropriate subscripts denotes the standard error of es- 
timate with multiple or partial correlation coefficients, the subscript 
j refers to the test, and the subscripts 1, 2, 3, --- r refer to the r 
orthogonal reference vectors. It is interesting to observe the beha- 
vior of the partial coefficient under these conditions. The partial co- 
efficient 7j2.. is given by the formula 


Tj2— Vj1° Tie 
V (1 —T1j,") (1 == 112”) 


Since 7: is the correlation between two orthogonal reference vectors, 
it equals zero, and we have 





T j201 == 








Tie Tj2 
TV j2-1 = Ss = 
V1l—fi oj1 
Thus 
‘ Nj2” O51" — 1 je” 
ee ee re ee 
Cj1 Oj1 
and 


ee eet Hy SS 
ee es, Tie ee ey 
Gj-312 —— Oj a ——— 2 arse ae 
jl 


Continuing the process with an additional test, 
Oj-128" — Oj-12" : 0 j3-12" 


The coefficient 7;;.:2., and all additional partial coefficients of higher 
order, will simplify in the manner shown above, that is, since all the 
variables exclusive of 7 are uncorrelated, the second term in the nu- 
merator and the second term in the denominator both vanish, so that 


liz 





Tj3012 = 
Oj-12 








4 PSYCHOMETRIKA 


and 


Then 


=—1— N53? — PL jo? — T 53" . 


This process can be continued until the rth factor is reached. Since 
all the residuals vanish when the rth factor has been removed, all the 
remaining entries in the matrix must be zero, and neither the com- 
munality nor the multiple correlation coefficient can be increased by 


adding further variables. Thus 
G7 5-123 ee 1 — 151° — 1 j2* — +++ — 75/7 ’ 


and 7j:,+:)? and all succeeding terms equal zero. 
But 7jm = jm, consequently 


G7 5323 62 2 p= 1 — (@j,? + jo? + ---+ a;,?) ; 


also 

hj? = ajy + Qj2? + +--+ aj? . 
Hence, 

Ojrg3-0- F =1—h?F ; 

Treg 0 oo p= 1 —— a jeags so oe . 
Therefore, 


hj? = 9° ;.303 ocere 


Since the correlation between any two tests 7 and k is zero after 
the r common factors have been removed, a second theorem follows 


immediately. 


2. The communality of a test 7 is equal to the square of the 
multiple correlation of test 7 with the r reference vectors and the 
n—1 remaining tests. 

From this follows a corollary which will be used later. 

Corollary: The square of the multiple correlation of a test 7 
with the n—1 remaining tests is equal to or less than the communal- 
ity of test 7. It cannot exceed the communality. 

This is readily seen to be so from the fact that 7;...,...,? cannot 
be increased by the addition of any or all of the tests of the battery. 

The question at once arises whether the communality is equiva- 
lent to the square of the multiple correlation of a test 7 with the n—1 
remaining tests without the reference vectors. Each reference vector 
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may be regarded as a variable with a communality of unity. When 
raw correlation coefficients are used, no test can have a communality 
of unity because of the presence of an error factor. As the number 
of tests is increased while the rank of their correlation matrix re- 
mains unchanged, the communality of any test must remain constant, 
while it can be shown that in general, under the same circumstances, 
the multiple correlation coefficient may increase. Consequently the 
two need not be equal, and the precise relationship is not determined. 
However, another theorem can be stated at this point. 

3. The square of the multiple correlation of a test 7 with the 
n—1 remaining tests equals the communality of test 7 if the group of 
tests contains r statistically independent tests each with a communal- 
ity of unity. 

When these conditions are met, the r reference vectors can be 
rotated to coincide with the r statistically independent tests, and the 
above proofs will apply. These conditions can never be exactly re- 
alized with raw correlation coefficients because of the error factors. 

When correlation coefficients which have been corrected for at- 
tenuation are used, it is possible for the communality of a test to 
approach or reach unity. If the number of tests in a battery in- 
creases indefinitely while the rank of the correlational matrix, and 
thus the communality, remains the same, it is then possible to find r 
statistically independent tests with a communality of unity and then 
the square of the multiple correlation of a test 7 with the n—1 re- 
maining tests equals its communality. Thus: 

4, With correlation coefficients corrected for attenuation, when 
the number of tests increases indefinitely while the rank of the cor- 
relational matrix remains ccustant, the communality of a test 7 equals 
the square of the multiple correlation of test 7 with the n—1 re- 
maining tests. 

With uncorrected coefficients the communality of a test must 
remain constant when new variables are added, if the rz 1k of the 
correlational matrix remains the same, while the multiple correla- 
tion coefficient generally increases under these conditions. However, 
it was shown above that the square of the multiple correlation of a 
test 7 with the n—1 remaining tests cannot exceed the communality 
of the test. This suggests that the square of the multiple correlation 
of a test 7 with the other tests might approach the communality as a 
a limit when the number of tests increases indefinitely while the rank 
of the correlational matrix remains the same. This can be shown to 
be so in a special case as follows. If all the coefficients 7;, in a column 
of a correlational matrix are equal, and if all the other coefficients 
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r, are also equal, although not necessarily equal to 7;,, the formula 
for the multiple correlation becomes (1, p. 311) 





nN 
Meats on= Tig] 7 + (eta ‘ 





As n increases indefinitely, 


OR Vanteg + vg RE womens 
nr-D Vik 
and 
e Vir 
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Under these conditions the correlational matrix is of rank one, and 
the communality of any test can be determined as 
aes Tj Fa Vir 


hia 





Thus, 

lim T* 2004 coon — h,? e 
It seems likely that this conclusion is true in the general case, but 
this has not yet been proved. 

The square of the multiple correlation of a test with the remain- 
ing tests in a battery can safely be used as an estimate of the com- 
munality of a test for practical purposes, for it cannot exceed the 
communality and will generally give a fair approximation. Whether 
this procedure gives more satisfactory results than methods now in 
use is a matter of fact which is yet to be determined. Since the mul- 
tiple correlation process becomes very unwieldy as the number of 
variables increases, it is desirable to have a method of approximating 
the value wanted. It is possible to select a small number of tests from 
a battery which will give almost all the information for this particu- 
lar purpose which could be obtained from a complete battery. A 
method of determining which variables to select for use here has been 
developed and will appear later. 
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ON THE USE OF MATHEMATICS IN 
PSYCHOLOGICAL THEORY 


(Concluded from previous issue) 


J. F. BROWN 


University of Kansas 


IV. NON-METRICIZED DYNAMICAL VARIANTS OF 
THE PSYCHOLOGICAL FIELD 


The topological concepts allow us to assign individuals and goals 
to certain spatial regions. They allow us to designate what locomo- 
tions are possible for an individual and what regions must be trav- 
ersed in attaining a definite goal. But the topological concepts alone 
tell us nothing of the actual locomotions performed in psychological 
activities. So far we have seen that the position of the individual at 
the start of the psychological activity may be defined in reference to 
this. Psychological activities may be ordered to locomotions. The in- 
dividual in this sense has the character of a thing. The space through 
which the locomotion occurs has the properties of a medium. (Cf. 
Heider (10). In physical problems where the field construct is used, 
one may make this same distinction. Bodies falling in the earth’s 
gravitational field have the properties of things, while the atmosphere 
is to be characterized as a medium. Similarly in the electro-static 
field, the isolated conductors have the properties of things and the 
field has those of a medium. In the following, individual point-regions 
will be considered as things, and the fields in which the locomotions 
occur as media. Media have dynamic properties such as fluidity, per- 
meability, cohesiveness and the like.* Our next step must be to in- 
troduce these concepts, define them, and give example of their use. 
These will only be illustrations; references to exact analyses in terms 
of a field theory will be given in Section VI. Such concepts are only 
of definite scientific value when they are capable of operational defini- 
tion. In other words, assignment of a certain fluidity to a field is only 
permissible when it is done on a definite experiential or experimental 
basis. They may perhaps be useful for speculation, before operational 
definition is possible. Our language of data is rich in phenomenologi- 
cal descriptions where non-metricized dynamic concepts are used and 
readily comprehended, and the adoption of them as constructs un- 
doubtedly originates in such phenomenological descriptions. But sc?- 

*Such dynamic terms have been frequently used by some sociologists and 
psychologists, usually without precise definition and without the realization that 


they represent theoretical constructs. It is hoped that the field-theoretical con- 
cepts will not be confused with these others. 
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entific meaning accrues to such concepts only when they may be pre- 
cisely, i.e., operationally, defined. At the present time we may define 
these concepts in terms of experimental or statistical indices. We use 
the term index purposely to distinguish such numerical assignations 
from real or fundamental measurement. Experimental indices are 
gained from actual experiments and have their greatest use in prob- 
lems of individual psychology. Statistical indices are used chiefly in 
problems of social psychology and sociology. Thus it is possible to 
use income-tax returns as an index for the permeability of bound- 
aries separating social classes, or from questionnaire results to ob- 
tain indices for the variation of field fluidities amongst social groups. 

In the following we shall suggest different operations which may 
be used in defining each concept. We do not wish at this early point 
in the development of field theory to commit ourselves to too definite 
procedures in defining our concepts, because, where several indices 
are available, it may later transpire that one of these has a particular 
value for a final definition. In each specific problem where these con- 
cepts are used, it is necessary to give them an operational definition. 
Unless this is done, the theory may become meaningless. 

The non-metricized dynamical concepts which we will use are 
fluidity, degree of freedom, of social locomotion, permeability, ten- 
sion, and vector. The application of such concepts to psychological 
fields where the psychological space is quasi-physical, i.e., where in- 
itial position and goal may be ordered to infinitely structured space 
(problems of mazes, circuitous routes, etc.), is quite obvious. For in- 
stance the permeability of an electrical grid as a barrier may be 
assigned an index figure on the basis of strength of electric shock. 
The strength of a vector towards the goal of a maze may be. non- 
metrically indicated by hours of hunger. For this reason we will deal 
chiefly with examples of problems where initial position and goal are 
not so easily defined. 

Fluidity. By the degree of fluidity of a medium is meant the ease 
of locomotion in the medium.* Ease of locomotion depends not only 
on the fluidity of the medium, but also on the distribution of barriers 
in the medium and on internal psychological factors. It has meaning, 
however, to speak of the varying fluidity of psychological fields in 
themselves. For cases of actual physical locomotion it is quite obvious 
that ceteris paribus locomotion by walking across a street is in a more 
fluid medium than swimming a stream of equal breadth. We speak, 
however, of the fluidity of psychological fields which have no imme- 

*Lewin uses fluidity in a somewhat different sense and believes that only 


under special conditions may the ease of locomotion be used as a criterion for 
fluidity. 
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diate physical correlate, and of the fluidity of social fields. Phenom- 
enally one “moves about” more easily in daydreaming than in per- 
ceiving. Day dreams normally occur in a plane of lesser reality than 
perception and one is justified in assigning a greater fluidity to fields 
of lesser reality than to fields of greater reality.* Under such condi- 
tions fluidity may be operationally defined through the rate of diffuse 
discharge of tensions in the different fields. The memory for per- 
ceived acts and phantasied acts may be used for gaining an index- 
figure to designate the fluidity. If the tensions in both fields may be 
considered equal, then perception may be said to occur in a field of 
less fluidity than phantasy when more perceived acts are remembered 
than phantasied acts. It goes without saying that such experiments 
require regular serial variation, control of motivation and the other 
usual psychological controls. 

Likewise social fields may be said to vary in fiuidity where fluid- 
ity means the ease of social locomotion. One speaks popularly of 
“stiff” formal parties and compares these with “free’’ Bohemian ones. 
The formal party is to be ordered to a field of low fluidity, the Bohe- 
mian party is to be ordered to one of high fluidity. 

Degree of freedom of social locomotion. By degree of freedom of 
social locomotion is meant the comparative number of directions in 
which social locomotion is possible. In a field having a high degree 
of freedom of social locomotion many locomotions are possible com- 
pared with a field having a low degree of such freedom. In general 
the degree of freedom of social locomotion varies inversely with the 
number of barriers within the field. The various social classes are to 
be ordered to fields of varying degrees of freedom of social locomo- 
tion. The bourgeoisie is to be ordered to a field of high degree of free- 
dom of social locomotion, the petite bourgeoisie to a field of medium 
degree of freedom, and the proletariat to a field of low degree. Index 
figures may be assigned to the degree of freedom of such fields on the 
basis of economic and sociological statistics regarding income, con- 
sumption, education, and the like. The various differences in degree 
of freedom of social locomotion is indicated in Figure VI. There is 
a close coordination between the number of barriers and their per- 
meability of which we will next speak. 

Permeability. By the degree of permeability of a barrier is meant 
the ease with which locomotions are executed through the barrier. 
Here one distinguishes between group- and inner-barriers. (Cf. 
above.) 


*Cf. the experiments of Brown, of Dembo, and of Mahler, reported in Lewin 


(16). 
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The group-barrier of the Catholic Church may be said to be less 
permeable than that of Protestant denominations. One can join most 
Protestant sects by simply going to the meetings, whereas to obtain 
membership-character in the Catholic region it is necessary to take 
instruction, become baptized, etc. Operationally then we are quite 


B. 


























FIGURE VI 


justified in saying that the barrier permeability of the Catholic Church 
region is less than that of the Protestant. Figure VII gives the dy- 


C oad 








FIGURE VII 


namical characterization of this situation. Differences in permea- 
bility will be shown by thickness of boundary. Similarly one may 
speak of differences in barrier permeability for other groups and de- 
fine the concept operationally. The boundary separating nations 
might be assigned an index of permeability on the basis of immigra- 
tion statistics, that separating class groups within a nation on the 
basis of income statistics, etc. 

Inner-barriers, which represent impediments to locomotion with- 
in social field regions likewise vary in their permeability. The bar- 
riers to which laws are ordered are more permeable in the field of the 
bourgeois than in the field of the proletariat. Operationally this may 
be indicated by the ease with which bail and council are obtained by 
the bourgeoisie in comparison with the proletariat. Similarly, such 
taboos as being late to work represent barriers of decidedly different 
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permeability for the executive, the salaried worker, and the wage 
earner. 

Vectors. The forces activating all locomotions in the psychologi- 
cal field are to be ordered to the concept of vector. These vectors rep- 
resent forces causing psychological locomotion and are directed mag- 
nitudes. Their analogies in physical fields are the lines of field force 
within these fields. Such vectors, which represent forces, are to be 
indicated by arrows whose direction indicates the direction of the 
force, whose length represents its magnitude and whose point of ap- 
plication is at the point of the arrow. (Cf. Figure I.) Vectors are 
also used to indicate locomotions as in Figures II, III, etc. Hence vec- 
tors represent the psychological force concepts. We say that the mag- 
nitude of vector varies directly with the ease of locomotion through 
fields and barriers of constant fluidity and permeability. 

In all cases of actual physical locomotion vectors may be assigned 
index figures (though not measured) on the basis of hours of hunger, 
the strength of electric shock which will be suffered in attaining a def- 
inite goal, ete. Such procedures are so well known to experimental 
psychologists that further elucidation of them is unnecessary. 

The assignation of “index-figures” for vectors for locomotions 
other than physical may be accomplished through the operational defi- 
nition of tension in terms of memory index figures, or in the tendency 
to resume interrupted acts. (16). 

In the social field, the relative strength of vectors may be opera- 
tionally defined through attainment or failure to attain membership- 
character in groups where the social goal lies within definite social 
regions or statistically through the outbreak of war, revolution or 
industrial strike. 


V. HODOLOGICAL SPACE 


Vectors are directed magnitudes and the problem arises as to the 
definition of direction in psychological fields. Lewin has recently at- 
tempted the mathematical solution of this problem, and has been able 
to show under what conditions direction of vectors may be defined 
and what the prerequisites to such definition are. The following lines 
give only his findings. For the mathematical deductions and proofs 
the reader must go to his original paper. 

For physical locomotions where there is no barrier between the 
initial position and the goal, the problem of definition of direction 
raises no particular difficulties. Direction is a binary spatial relation- 
ship, which may be defined in Euclidean space by two points and their 
sequence. Hence the direction from point a to b of a Euclidean plane 
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-_ 


is given by the straight line joining them. The direction of the vector 
underlying physical locomotion, where there is no barrier lying in the 
line between the organism and the goal is given by the straight line 
joining the organism and the goal. Hence a child walking towards a 
piece of candy in a room, is to be ordered to a field as in Figure VIII. 














FIGURE VIII 


Such situations, however, are of little psychological interest and as 
soon as a barrier is imposed, the direction of the vector in quasi-physi- 
cal space is more difficult of definition. Lewin introduces the concept 
hodological space, (i.e., space of the path) and distinguishes between 
special and general hodological space. Special hodological space is 
space in which direction is defined by the initial differential of the . 
distinctive path between two points in the space. By distinctive (aus- 
gezeichnet) path Lewin means one distinguished through some dy- 
namic criterion, such as being the shortest in time, space, energy ex- 
penditure, or, under other conditions, longest in time, etc. Conse- 
quently, if a barrier is placed between the child and the candy in the 
above example, the hodological direction is as given in Figure IX. 
The properties of such a space are immediately dependent on the psy- 
chobiological dynamics of the situation, because direction in it is de- 
finable only when these factors are taken into consideration. We saw 
above (Section II), however, that such a procedure is quite allowable 
in modern geometry. All problems of physical locomotion, where the 
initial position of the organism and the goal may be ordered to definite 
points, may be handled in special hodological space. However, in ho- 
dological space as opposed to Euclidean, there are multidimensional 
regions where the points are undifferentiated with regard to direction 
from a given initial point, and there are point-pairs which are not re- 
lated by a direction. Thus in Figure X, all the points in the shaded 
region A lie in the same direction from P,. (The directions P,.2, P,;, 
P,,, are hodologically identical.) There is further no direction be- 











. 
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FIGURE IX 


tween P, and P, in Figure XI, as there is no path between them. The 
direction in quasi-physical space depends on the properties of the 
properties of the total field. 





FIGURES X AND XI 


When we attempt to define direction for problems where there 
is no direct correlated physical locomotion (problems in quasi-social 
and quasi-conceptual space) the difficulties which beset us are even 
greater. Physical space is usually infinitely structured (durchstruk- 
tuiert), while conceptual and social space in general only allow posi- 
tion to be topologically defined, i.e., they are structured, but not in- 
finitely structured.* Consequently the paths in general hodological 


*Cf. the distinctions structured, unstructured, infinitely structured, given 
above. 
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space are between topological regions rather than between points. 
Direction in general hodological space is defined as the step from the 
initial region to that contiguous region, which lies in the distinctive 
path to the goal. In the example given above, of the freshman and the 
fraternity, the direction towards C can be defined through the loco- 
motion A to B. The direction in general hodological space is hence 
relative to the degree of structure of the psychological space. Lewin 
defines psychological space as a general hodological space. Conse- 
quently, the magnitude of our vectors may be defined in terms of an 
index-figure and its direction in terms of hodological space. 


VI. EXISTING APPLICATIONS OF THE 
FOREGOING CONSTRUCTS 


K. Lewin first applied topological concepts to psychological re- 
search. Lewin’s consideration (13) of the existing relationship be- 
tween psychology and the scientific method convinced him of the ne- 
cessity for an hypothetico-deductive approach. He was further con- 
vinced that psychology should use precise, mathematically defined 
theoretical constructs. For the reasons given above, topological con- 
cepts were seen to be the most adequate. Topological concepts alone, 
however, cannot investigate dynamical processes and Lewin has made 
wide use of non-metricized dynamical concepts. We also owe to Lewin 
the development of hodological space. 

The chief experimental researches based on this methodology are 
included in a series of papers entitled “Untersuchungen zur Hand- 
lungs-und Affektpsychologie” appearing currently in Psychologische 
Forschung. This series of papers is composed chiefly of dissertations 
done under Lewin’s direction. There is now available in English a 
translation of certain of Lewin’s theoretical papers (16). This last 
work ends with a chapter which abstracts the individual papers of 
the Forschung series. A larger work of Lewin’s is to be published 
shortly. (14). 

Lewin has also suggested the applicability of his method to the 
problem of sociology and social psychology (14). The writer has at- 
tempted to apply this suggestion in a methodological consideration of 
social psychology (3). At the present time the writer is engaged with 
a larger work on social psychology from the standpoint of the theory 
of the social field, which he hopes to publish within the next year. 
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RELIABILITY COEFFICIENTS IN A CORRELATION MATRIX 


SAMUEL A. STOUFFER 
University of Chicago 


Given s fallible tests ¢,, t,, --- t,, the problem is to express their 
intercorrelations in terms of the average correlations between a 
varying number of parallel forms contained within each test. A new 
correlation determinant 4’ is derived containing d;; instead of unity 
as an element on the principal diagonal, where 

d;,;=(1 + (m;,—1)7;,]/m,, 
in which m,; is the number of parallel forms comprising the 7’th test 
and 7; is the average intercorrelation of the m;(m,; — 1) /2 parallel 
forms. As m; — ©, d;,; approaches the correlation “corrected for 


attenuation.” These results make explicit the assumptions, as to 
intrinsic accuracy of all measures, which are implicit in the usual 
multiple and partial correlation analysis. These results also make 
possible a simple procedure for estimating the effect on various par- 
tial correlation measures of improving the accuracy of part or all 
of the measures by including additional parallel forms. 


Given s fallible tests t, t.,--- , t,, to express the conventional cor- 
relation determinant 





Ll Tet +++ Tet 
12 1e 
r 1-7 
Ac tt, et (1) 
| Trt Tee os 1 
1s 2s 


in terms of the intercorrelations between parallel forms comprising 
each test t;. Write 


by a FA + Aim, 
te = @ + i os 


t= 2+ 2 sone By oso ae Ry 


ty = 2, + Sse Ze ott Zan, , 
where each 2;, is one of m; parallel forms comprising test & and 
is expressed in standard measure, that is, 


ai, = (Xi, —_ Xi,) /vi, ’ 
in which X;, is a raw score and Xj, and o;, are the mean and standard 
—_ 
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deviation, respectively, of the raw scores. Since 
725, = 1s 072, = Mit ATi, + Myig 0° Fin, sin, 
= mi[1+ (mi—1)rii] » 
where . 
Ti = ATi, Higig Ti, yin) /mai(mi— 1) » 


1m; 


the average of the m(m—1) /2 reliability coefficients. 
Write 7:,:,—= > t; t;/no:,0;,, where n is the number of individ- 
uals taking the tests. Since 


D Zin 2j,/M= Mi, 2 DE G/N =T ij, $ isi oF iin 


+ Vim: + Vim js rt: + Fin Smn, = MM; Ti; » 


where 7,; is the average of the m; m; intercorrelations. We then have, 




















chien Mi M; Ti; 
¥ mm [1+ (m,—1)rii) [1+ (m;—1)7;;] 

_ rs 
i | 1+ (m;—1)r;; ‘ee (m;—1)7);3 7 

\ mM; ‘| mj; 

Fis 
™ i = 
where dj; = [1 + (m; — 1)7ri:]/mi.* 


*Equation 2 is identical, though it is expressed ‘n different notation, with 
(147) in Truman L. Kelley, Statistical Method, page 197. It is assumed that each 
parallel form comprised in t; has unit weight. If the m,; forms are assigned 


varying weights w,, (k = 1, 2, --+ m;), Kelley’s (149), page 198, may be used. 
Substituting (2) in (1) we have 





Ti2 N18 | 
Véada  Vdudu | 
12 ‘ Teg 
aie V dos des (3) 
Tas Tes 1 
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— A’/d,, dep +++ dss , Where (4) 


dys Tin ++ Tis 


VA \4 12 Az +++ Ts F 


| 








Tis Tes _— dss 
while any (s — 1)-rowed minor of 4, 


V dis dj; 


ces oo lal 


where A’;; is the corresponding minor of 4’. 

As all values ri; > 1; and as all values 7;; > 1%,;,, the corre- 
lation between any two parallel forms in ¢; and ¢;; Equations 3 and 
4 approach the form 








1 M2 +++ Tis 

a er 
A= 12 "| : 

Tis Tos **° 1 | 





As m;, the number of parallel forms of the i-th test, ~ o (so 
that 1/m > 0), 


dy = | r+ 





a form of the correlation between measures of the 7’th and 7’th tests 
“corrected for attenuation,” permitting us to write, from (4) 


A == A”/?,, a2 °°* Tee ’ (5) 
where 
T11 Tin +++ Nis 


A’ = Tro Teo °** Tos 


Tis Tos °°? Nes 
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It is thought that these relationships may help to make explicit 
some of the assumptions implicit in the use of test measures in cor- 
relation analysis, as well as to provide a practical technique for esti- 
mating the probable effects on final correlation results of improving 
a part or all of the tests by including additional parallel forms.* 


Examples of Derived Measures when s = 3. From Equation 4, 
when s = 3, we have 


























r 7 A. we A's. or iz Ags — Tr3 T23 
tite-ty =< = = = 
/ As. Ay / 4'22 A’, V (dy, dss — 113) (de. dss — 123) 
(6) 
A, Ar n doo Tr Asz3 — Tis Tos doo 
=> — = = —— 7 
Peston An Mn dy, doz d33 — 1723 dy, (7) 
A A’ 12 Ass + 1743 dos — 2 Tis Tas Vos 
FB, 1, =1— =1—-; — = 
i An A's, dy 4; (doe d23 — 1723) 
(8) 


Equations such as these may prove valuable not only in cases 
where d;; and 7;; are known, but also in cases where it is desired to 
insert various guessed values of di; and 7;;. As m,, m, and ms, the 
number of parallel forms, approach «, di; > 7rii, from (5), permit- 
ting us to rewrite (6), for example, as 
= Tie a3 aay Tas Tes 

MA (Tn Tn — 7,3) (22 Tss — 7°45) 
a useful form provided that we feel reasonably safe in our estimates 
of Ti and Tij ° 


, (9) 








T tte ts 


*This paper presents a further generalization of results obtained by setting 
each t; = z; + 2’;, as reported by the writer in “Evaluating the Effect of In- 
adequately Measured Variables in Partial Correlation Analysis,’ Journal of the 
American Statistical Association, June, 1986. Applications given in this paper 
make use of sociological and economic data, though it would be very easy to find 
examples in the psychological field. 
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FURTHER CONTRIBUTIONS TO THE MATHEMATICAL 
THEORY OF HUMAN RELATIONS 


N. RASHEVSKY 





University of Chicago, Chicago, Illinois 


In continuation of a previous paper, some consequences of the 
fundamental equations established there are studied. For some 
simple hypothetical cases it is shown how some of the parameters 
which enter in the equations governing the structure of the social 
group can be determined by means of those equations from actually 
observable data. Furthermore some general properties of the varia- 
tion with respect to time of the fundamental distribution function, 
which enters in the equations, are derived. 


I. 


In a previous paper* we have outlined a general mathematical 
approach to a deductive, theoretical science of human society. We 
have established various general forms of equations which can be 
used for that purpose, and indicated the way of describing in mathe- 
matical terms some phenomena of social interactions. In those fun- 
damental equations we have been making use of some quantities 
which directly are not accessible to physical measurements. We jus- 
tified however this procedure by invoking the example of physical 
sciences, where equations are established between quantities which 
may directly be inaccessible to measurements, but which yet are meas- 
urable “in principle”. This “measurability in principle” is made pos- 
sible by the application of the mathematical equations, which even- 
tually give us connections between those directly unmeasurable quan- 
tities and others which can be measured directly. It is the purpose 
of the present paper to extend the preceding study and to illustrate 
by means of a few examples the way by which in the ultimate devel- 
opment of the theoretical system, a measurement and determination 
“in principle” of the quantities involved can be achieved. We shall in 
other words, derive some special consequences from some of the gen- 
eral equations, and show how those can be in principle compared to 
observable data. 

We must however very strongly emphasize again, that such a 
comparison in principle does not mean a comparison with actual ex- 
isting data. We are here concerned with a purely deductive, theo- 
retical science, and we therefore study at first purely imaginary cases, 


*Phil. of Sc., 1935, 2, 418, hereinafter referred to as loc. cit. 
— 
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which due to the intentional oversimplification, have no real existence. 
If we speak of a comparison of an equation with observable data, we 
meant thereby just this: we consider a simple, theoretically possible, 
but not an actual case, and set up equations which describe it. The 
equations themselves may be of such a nature, that even if this case 
studied would really exist, they would not be directly verifiable. But 
some of their consequences could be compared with observable data, 
which would be available if our case really existed. 

Inasmuch as even the simplest actual cases are much more com- 
plex than the imaginary cases with which we perforce must begin, 
no claim whatsoever can be made at this stage for any practical ap- 
plication to actual cases. In the long run however after a systematic 
study of more and more complex cases, we may arrive at a represen- 
tation of some actual ones. But this will of necessity require a great 
deal of preliminary, purely abstract theoretical study. This has been 
the way of all exact science.* 


II. 


We shall begin by considering the simplest case of one activity 
only, represented by equ. 5, loc cit., and first simplify the case 
still further by considering that all individuals have the same desire 
w for the activity a;, and differ only in their coefficients of influence 
F. The activity a; itself may be of any kind: production of food or 
other practical necessities, or any artistic activity, like painting, com- 
posing, etc. The proper practical unit for a; may vary from case to 
case. But in principle for a given activity its intensity a; may be ex- 
pressed by the amount of energy spent on it, on the average, per unit 
of time. Since in the absence of the influence of others we have: 


a;—aw, (1) 


where a is the coefficient of proportionality, dependent on the choice 
of units, we may measure w by the amount of a;, which an individual 
does of his own free will. Then the dimensions of both a; and w are 


[m] [/]*[t]~ (2) 


and, since # is also only a coefficient of proportionality, F becomes a 
pure number. Putting in equation (5) of loc. cit. a = 8 = 1 and re- 
membering that in the present case w = w’, we find for two indi- 
viduals 
a,—w[1l-+ (F’—F)]. (3) 
*Cf. our paper in Phil. of Sc., 1, 176, 409, 1934, 2, 73, 1935. Nature, 135, 
528, 1935. Biol. Rev. 11, 345, 1936. 
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We see that the difference of the coefficient of infiuence of two in- 
dividuals equals to 1, if one of them can through his influence on an- 
other induce him to double the amount of the latter’s activity done 
of free will. 

Of course we must remember that this holds only for the partic- 
ular hypothetical case which we decided to consider here. Adoptions 
of different postulates will require a modification of the set-up of 
units, but the procedure remains fundamentally the same. In sub- 
sequent publications we intend to make a systematic investigation of 
all possible postulates discussed in loc. cit., as well as of some dif- 
ferent ones. 


III. 


The next question is the choice of a function N(F, w), which in 
our case degenerates into N(F). Again the proper procedure would 
be to investigate various possible N(F), and to begin with the sim- 
plest cases. One may think that a normal distribution should be in- 
vestigated first. In view of its wide range of applications in statis- 
tics, a normal distribution certainly deserves a separate study. In 
view however of the fact that the evaluation of some integrals in 
finite form becomes impossible for a normal distribution, we shall 
consider here a different one, namely: 


N(F) =AFe“ , (4) 
A and a being positive constants. This N(F) is equal to zero for 
F = 0 and F = o, has a maximum for F — 1/a, and an inflection 


point for F = 2/a. 
From the requirement that 


[wares (5) 
0 
where §% is the total number of individuals, we find 
A= a? r) (6) 
so that 
N(F) =e Fe? . (7) 


It may be argued that the integration in (5) should be carried 
out not from zero to infinity, but from zero to F,, F',, being the maxi- 
mum value of F that occurs in the population. This would give 


A=/[1/a? — (Fn-+ l/a)e*"/a] , (8) 


which reduces to (6), if Fm is so large that e“"™ is very small. In 
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this paper we shall confine ourselves to such a case, and use (6) in- 
stead of (8), though the whole theory may be developed in quite a 
similar way on the basis of (8), leading only to somewhat more com- 
plex formulae. 

Of particular interest is the case where only one individual in the 
group has the highest F,,,. We then have 


N (F'n) ce Na2F eam — | ; (9) 
or 
log N + log a+-logaF,, —aF,—0. (10) 
Neglecting log aF,,, as compared with aF,,, we find approximately 
F,= (log N+ loga)/a . (11) 
IV. 


With the shape of N(F) chosen, let us turn to the equation gov- 
erning the formation of “social classes’ discussed in section IV of 
loc. cit. Taking as the criterion of “association” equation 16 of loc. 
cit., 

' (F°’—F)?*< 4, (12) 
the lower limit F, for the “upper class” is given by the root of the 


equation 


Fa Fun 
f f [ (F’ — F)? — A?] N(F)N(F’)dFdF’=0 . 
Fe Fe (13) 
Introducing into (1) for N(F) and n(F”’) the expression (7) we find 
after somewhat elaborate calculations: 


8 A? 


2 a2 —2aF 2 2 A2 S 4 2A’ 4 
M2 a? {e-24F [(({—4 )F2+ ({——) F.+5—Gl 
i 2 sli 8 22a? 4 Jf 
+ ets [(<— A) Fe + (S———) Fat GG 


F,, 1 
— 2 e*FeFa) [ (F,, 4 -)F — or at 2 F,2) F 2? 














i oF ’.* 4F,,, 2 4 A? 4F,, 
+ (F,,° — a ae Fata me ar ae 
A*F 4 A* Fa? F* ) 
m 0 : 14 
a a* a a a? ] J ( ) 
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An exact solution of this transcendental equation is rather difficult, 
but we have an approximate expression for the case that A is suf- 
ficiently small and therefore F, is large, however so that F, < < Fy. 
Then we may neglect the term multiplied by e-**"" as compared with 
those multiplied by e*“"*, and also keep in the braces only terms in 
F; and F,’. This gives 


(5 ay kee —2 (Fn p LyFe etter = 0, (15) 
or after transformation, 


2 Fu, i. 
log a elie She ha —aF, 





—logaF,-+aF,—0 , (16) 

and again neglecting log aF, as compared with aF,, we finally obtain: 
2(F'n/a-+ 1/a*) 

F,—F,,—a log Var A ° (17) 


Since 2(F,,/a + 1/a?) = 2/a? + 2F,,/a > 2/a? — A’, the log in (17) 
is positive and F, < F,,. With increasing A?, F, decreases, as should 
be the case. 

V. 


Another relation involving F, is obtained by considering the ra- 
tio 3 of the number of individuals of the upper class, to the total num- 
ber of individuals in the society. This is given by 


o= [NP)af/ [Naar . (18) 
Introducing (7) into (18) we find: 


9 = a(F.4+ —)e* , (19) 


or 
d= (aF,+ 1l)e . (20) 


Equ. (20) gives a relation between F,, a and # which latter is a di- 
rectly measurable quantity. For the case aF, > 1, (20) may be sim- 
plified thus: 


0—aF,e% , 


or 


log 3} = log aF, —aF, . 
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Neglecting again log aF, as compared with aF,, we find 
1 
F,=—~ log 0 . (21) 


F., is always positive, because 3 < 1. 

A still further relation is provided between F,, a and w, which 
we consider as constant, by calculating the total amount A of the ac- 
tivity of the whole group: 


aca [cn yar aw [NaF +w | NOYaF 


x [NG (FP —Fyar’ , (22) 


which can also be easily calculated by using (17). The constant de- 
sire w of every individual being also measurable in principle, we 
have 4 equations: (11), (17), (20) and (22) by means of which we 
can express F,,,, F,, a and A in terms of 3, A and w. We see thus how 
the various quantities, which we introduced into our fundamental 
equations and which directly cannot be measured, can nevertheless 
be determined by means of the equations themselves, from other di- 
rectly measurable quantities. Similar investigations will be carried 
out for more complex cases, involving more variables. 


VI. 


Now let us investigate somewhat closer the function N(F) _it- 
self. In loc. cit. we have considered the variation of N(F’) due to the 
fact that the progeny of an individual with a definite F may have in 
general a different value of F. Let again p(F*,F) be the number of 
individuals having a characteristic F and born of parents F*. In gen- 
eral we must consider the case, that the two parents have a different 
F, but for the time being we confine ourselves to the simpler case, that 
both parents have an identical F. The total number of individuals 
with characteristic F, born of any parents per unit time is (loc. cit., 
equation 29) 


[ON yp F)aF , (23) 
where n(F*) denotes the birth rate per individual. If m(F) is the 
death rate also per individual, we have for the total change of N (F,t) 
per unit time 
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ne = [ney (Ftp FP) dF" — m(F)N (PF) , 


(24) 





Let us consider the simplest case, that both n(F’) and m(F) are con- 
stants, that is that the birth and death rates are the same for all 
types of individuals. Then (24) becomes: 


oN (F,t) 


ot 





— f “N (F*,t)p (FF) dF* — mN(F) . (25) 


We shall solve equation (25) by putting 
N(F,t) =N*(F) p(t) , (26) 


where N*(F) is a function of F only, and g(t) is a function of ¢ only, 
and determining N,(F) and g(t) so as to satisfy both equation (25) 
and the requirement that an initial moment t, which we may put 
without any loss of generality equal to zero, N (Ft) should be a given 
function N,(F) of F. 

Introducing (26) into (25) we find: 


N*(F) = ng (t) [Meo pyar —mN*(F)@(t) , 





(27) 
or putting 
nf N*(F)p(F*,F) dF 
N° (F) —m—a; (28) 
at —cc—a |p ’ (29) 
which gives 
g = Ae" , (30) 


A being a constant of integration. 

For every given value of a, equation (28) gives us an equation 
for the determination of N*(F). But (28) can be written after sim- 
ple rearrangements in the following way: 


N*(F) = f “N'(F")p(FF)dF) , (31) 


n 
a-+m 
which is a homogeneous integral equation of second kind, with the 
kernal p(F*,F’). Equ. (31) possesses solutions only for definite val- 
ues of the constant 
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n 
apn» 32 
am (32) 
Let d,, de, --: , A; be those “eigenvalues” arranged in increasing order 
so that: 
A, < dn SAs<es. (33) 


Then in order that (31) should have solutions at all, a must have 
one of the values 


n—Am MN 
If N;*(F) is an eigenfunction of (31), corresponding to the eigen- 
value A; then: 


A,N;*(F)e 


is a particular solution of (25), and the general solution is given by: 
N (Fit) =S Ai Ne (Fe (35) 

For t = 0, this is equal to 
N(F0) =3AsNi(F) » (36) 


and since all N;*(F') form a complete orthogonal system, the coef- 
ficients A; can be determined so, that 


SA, Ni(F) =Ni(F) . (37) 
We have 
— [Nore (Far (38) 
0 
Equations (35) and (38) represent the general solution of (25). Let 


us consider some of the consequences. 
On account of (33) we have: 


4, >@>4; >+::> 3; a@.=—™M. (39) 
If 
m > — (40) 
1 


then all a’s are negative. In that case, regardless of the choice of the 
coefficients A;, in other words regardless of the initial distribution 
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N,.(F), the expression N(F,t) given by equation (35) tends to zero. 
Expression (40) sets, therefore an upper limit for the death-rate m, 
above which the social group will with time become extinct. 
If however 
n 


m< _ (40a) 
1 


then some a’s, say a1, a2 ++: a, Will be positive, others ai.:, aero +++ Will 


be negative. But then all terms in (35) above the s-th will tend to 
zero, while the first s terms will increase. But with increasing ¢ the 
term with the largest a, that is the first term, will exceed the others 
more and more, the ratio 


ert/est = (iS 8) 


tending to zero. Hence after a sufficient time has elapsed, N(F,t) 
will be given by 


N(F,t) =A, N,*(F)e™* . (41) 


Equation (41) shows, that the total number %t of individuals will in- 
crease exponentially, but the distribution N(F) will not vary, being 
given by the first eigenfunction N,*(F') of the integral equation (31). 


A similar result holds for the special case that m = . Then a, 
af 


= 0, all others are negative, and (35) tends asymptotically to 
A,N,*(F). In this case not only does the distribution function tend 
asymptotically to a fixed form, but the total number of individuals 
also tends to be constant. 

We thus find a fundamental result: under the simplified assump- 
tions made here, the distribution function N(¥') tends always either 
to zero or to a stationary distribution, which is determined by the 
function p(F*,F), since the latter is the kernel of the integral equa- 
tion (31), whose first eigenfunction determines the stationary dis- 
tribution. Any disturbances, like wars, starvations, etc., may upset 
this distribution temporarily, but in time it will again be restored. 
In a subsequent paper we shall investigate a special case of p(F", F’) 
and the resulting N(F). 

In loc. cit. we have seen, how the variation of N(F) with time 
determines the variation of the social structure and causes eventually 
its instability. Observations of the variations in time of the social 
structure may also lead us to equations which connect some of the 
directly unobservable quantities with directly measurable ones. For 
instance, as we have seen in loc. cit., due to variation of N(F), the 
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second class will contain a certain number of individuals with F > 
F,. If the variation of N(F) with respect to time is given, then this 
number R of individuals with F > F, is also given for any moment, 
R = R(t). But these individuals will not be controlled in a normal 
way by the first class. If, as is usually the case, such controlling class 
uses various methods of coercion against active political opponents, 
then R(t) wouid represent the number of individuals subject to such 
coercion, and this number can be directly determined. If this num- 
ber is N,, then 

R(t) =N, (42) 


gives us an equation, involving some parameters, which determine 
the variation of N(F), p(F",F), etc. Together with other possible 
equations it may be used to calculate those parameters. 


VII. 


In the general case the coefficient of influence may itself be a 
derivative notion. If an individual can easily perform and does per- 
form an activity the results of which are badly needed by another 
individual then the first individual may have a strong control over 
the second. We may thus consider the coefficients of influence as be- 
ing functions of the activities. For the case of two activities the sit- 
uation is mathematicaliy represented in the following manner. 

Let each individual be characterized by the desires w, and w, 
for the performance of the activities a, and a., and by the desires 
u and u, to possess the results of the corresponding »ctivities, with- 
out actually performing them: 

Then: 


A, (W,,U;,W2,U2) = aw, 


. s 6 
+ fu, | N (01,1, W'2,U' 2) Ap (W";,U’1,W"2,U’2) UW, dw’,dw ,dw’,du’, 
(43) 


Ae (W,,U;,We,U.) = aWs 





t 
+ pu, i} N (0; ,,W'2,U's)Q, (W’,,U’,,W'o,U’s )W’dw’,dw’,dw’.dw’, | 


The integrals in the right-hand side of both equations are constants, 
which we denote by A, and A, respectively. 


d,—=aw,+ A,pu,. | 


A. = aw. 1 A.fu, . (se) 
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The constants A, and A, are determined from the two equations 


A,.= | °N (WyiyWeytle) Uy (as + Aafu,) dw,du,dw.du, ; 


on (45) 
A,= | N (W,,U1;W2,U2) Us (aw, + A,Bu,)dw,du,dw.du, . 
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Using scores of 1200 students on a long test as a criterion, 
each of five subtests of different difficulty has maximum correlation 
with the criterion when the criterion is dichotomized at a value ap- 
propriate to the difficulty of the subtest. A 50-item test element is 
scored on an all-or-none basis with different standards for passing, 
and the percentage of passes for successive points on the criterion 
variable is computed. The Constant Method is applied to this rela- 
tionship. The limen thus computed is a measure of difficulty, the 
dispersion is a measure of average (or total) validity, and the slope 
of the curve is a measure of differential validity. The difficulty of a 
test element is thus directly related to the maximum differential 


validity. 
J. EXPERIMENTAL DATA 


The problem set in this investigation is the relationship between 
the difficulty of a test or test element and the degree of ability best 
discriminated by the test. The emphasis is properly placed upon the 
accurate description of difficulty and validity by the use of a simple 
mathematical function which will describe both in the same setting. 
Moreover, this function is to be brought into significant relationship 
with the statistical methods commonly employed in the interpretation 
of test results. 

The test used in this investigation was the Co-operative General 
Culture Test, Form 1933.* The test is composed of 803 items, and 
requires 180 minutes. The choice of this test was based on the follow- 
ing requirements: (1) complete objectivity, (2) freedom from faulty 
items, (3) length, (4) possibility of getting a large sample from a 
representative larger population, (5) a wide distribution of difficulty 
of items. These requirements were approximately met by the Co- 
operative Test. The subjects were 1,200 college sophomores, a ran- 
dom sample from the 8,996 included in the norms provided by the 
Committee on Educational Testing. The data, on punched cards, were 
used at this time to eliminate faulty or completely invalid items. Using 
total score on the test as a criterion, the population was divided into 
twelve criterion groups of one hundred each. For each item, the per- 
centage of correct response was computed for each of the twelve 


*The 1933 College Sophomore Testing Program. Report by the Committee 
on Educational Testing. Washington: American Council on Education, 1933. 
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groups. These twelve percentages were plotted against the cor- 
responding average criterion scores of the twelve groups. The slope of 
this empirical curve was taken as a crude measure of item validity. 
Items with flat or negatively sloping curves were not used in the ex- 
perimental subtests. This impressionistic inspection of the validity 
of the items resulted in the elimination from the experimental tests 
of thirty or more items of doubtful characteristics. These items were 
allowed to remain in the criterion, their effect being assumed as neg- 
ligible because of the length of the total test. From the 780 items re- 
maining, five subtests were selected. The composition of these sub- 
tests is described in the following table: 


TABLE I 
COMPOSITION OF EXPERIMENTAL SUBTESTS 











Percentage of | Number of 
Subtest Description Correct Answers | Items 
A Very easy 78-95 | 50 
B Easy 60-77 50 
C Average 41-59 50 
D Difficult 23-40 50 
| E Very difficult 5-22 50 











The choice of items for the subtests was based on the following 
considerations, in order of importance: (1) absence from defect, 
(2) percentage of correct response, (3) balanced positions in the 
original test, so as not to give disproportionate emphasis to any type 
of material. To each of the 1,200 subjects a score was given upon 
each of the five subtests. This scoring was done by machine methods 
to insure a high order of accuracy. 

The scores on the total test were taken as the “criterion” for 
purposes of this study. The raw scores were converted to normalized 
standard scores, by groups of 50 subjects. The criterion score of the 
fifty subjects in each of the twenty-four groups was considered to be 
the centroid as computed by the formula 


2:—Ze 


P2—Pi- 


= 





where zx is the centroid of a truncated segment of the normal curve 
with unit standard deviation, z, and z. are the ordinates enclosing the 
segment at the left and right respectively, and p, and p. are the pro- 
portions of the area under the curve from the left to the ordinates 
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with the same subscripts. This procedure is merely a device for di- 
viding the normalized criterion scores into a usable number of class- 
intervals. 


II. PREDICTING TO A CRITERION OF TWO CATEGORIES 


For many purposes we are interested chiefly in estimating from 
the test scores to which of two categories of some predicted variable 
the subject belongs. For instance, the testee is “qualified” or “not 
qualified” on an employment test; he is “passed” or “failed” on a 
test of achievement. The variance of criterion measures within each 
of the two categories is thus often neglected in practice. If the score 
meets a standard specified for the purpose of the test, it may not 
matter how much individuals, all meeting the standard, differ among 
themselves. The characteristic of the test which affords discrimina- 
tion between individuals at different parts of the criterion scale will 
be referred to as “differential validity” in the subsequent discussion. 
It is pertinent to inquire the extent to which tests pitched at different 
levels of difficulty differ in the property of allocating the subject to 
two categories. 

It might be expected that a sufficiently long test, homogeneous as 
to difficulty of test elements, would approach a condition of uniform 
differential validity for the total range of the criterion. This argu- 
ment is based on probability theory, and there is not available any 
empirical evidence which could be used to test such a generalization. 
For a uniform difficulty of items which is not p — .5, the distribution 
of scores will be skew, for small and moderate values of n, the num- 
ber of items. It would be possible, with much labor, to test empirical- 
ly the degree of skewness of the distribution of scores of very long 
tests of homogeneous difficulty other than 50 per cent. It is not prob- 
able that the skewness diminishes to negligible values for tests of any 
practicable length. Associated with this skewness, there should be 
differences in the validity of test for predicting into two categories. 
It is possible to determine the degree to which the five tests of equal 
length but of varying difficulty are valid for predicting into two cate- 
gories. The criterion was systematically divided into two categories 
at twenty-three different points indicated in Table II, and bi-serial 
r’s were computed for each. The choice of bi-serial 7 as a statistic for 
this purpose depends upon its special properties. The important 
property for our present purpose is that, for normal distributions of 
the continuous (non-dichotomized) variate, the value of bi-serial r is 
invariant with respect to the point of dichotomy. Another property 
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which must be noted in passing is that bi-serial r has limits of +1 
only when the continuous variate is normally distributed. 

Table II gives the values of bi-serial r for a large number of 
points of dichotomy of the criterion. These values are also represent- 
ed in Figure 1. 


TABLE II 


Bi-Serial Coefficients of Correlation of Subtests for Various Divisions 
of Criterion into Two Categories 




















Criterion Coefficients 
Per- | Per- | | 
centage centage | 

in Upper, in Lower | A B | c |} D E 

Category Category | | 
4.17 | 95.83 466 .570 | -728 | .976 1.066 
8.33 91.67 504 600 | .771 | 1.040 1.129 
12.50 87.50 549 663 | .823 | 1.059 1.096 
16.67 83.33 -580 689 | .848 | 1.072 1.089 
20.83 79.17 .611 -721 | .884 | 1.046 1.051 
25.00 75.00 645 744 | .918 | 1.026 1.012 
29.17 70.83 .675 -787 | .984 | 1.022 978 
33.33 66.67 mf .821 949 | 1.001 .956 
37.50 62.50 -746 843 | .977 | .983 .940 
41.67 58.33 783 875 | .998 | .953 .892 
45.83 | 54.17 826 907 | 1.015 | .941 862 
50.00 50.00 860 .939 | 1.027 924 825 
54.17 45.83 .900 960 | 1.080 | .904 811 
58.33 41.67 .927 .986 | 1.030 | .900 -779 
62.50 37.50 957 1.012 | 1015 | .871 -752 
66.67 33.33 .984 1.027 | 1.008 | .850 -728 
70.83 29.17 1.007 1.040 | 1.003 .818 .699 
75.00 25.00 1.013 1.032 | .978 -786 .670 
79.17 20.83 1.048 1.042 .969 .768 .653 
83.33 16.67 1.102 | 1.056 | .940 -720 613 
87.50 12.50 1.189 | 1.054 | .912 679 562 
91.67 8.33 1.148 | 1017 871 .644 503 
95.83 4.17 1.148 | 1.007 | .813 597 445 











It is clearly seen from Figure 1 that Test A (the easy test) is 
most effective in separating off a small percentage from the lower 
part of the criterion distribution. Test E (difficult) is likewise most 
valid for separating off a small percentage of the criterion at the 
higher part of the distribution. The other tests have points or regions 
of maximum validity which are intermediate in the appropriate or- 
der. Test A is most valid for prediction to a two-categoried criterion 
which is divided at approximately —1.4c. Test B is most valid for a 
criterion divided at approximately —1.0c. Test C is most valid for a 
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criterion divided at —0.10c. Test D is most valid for a criterion di- 
vided at approximately 1.00. Test E is most valid for a criterion di- 
vided at approximately +-1.4c. 

These results prove, in a qualitative fashion, that fifty-item tests 
have pronounced differential validities appropriate to the various 
levels of difficulty. The objective of the next section is to outline in a 
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more useful fashion a method of describing the difficulty of a test 
element and its validity in terms of a test discrimination function. 


III. THE DISCRIMINATION FUNCTION 


1. The Theoretical Curve 


The difficulty of a test element which is objective may be simply 
described by the percentage of the population failing (or passing) the 
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item, i.e., by g or p. This definition of difficulty makes the one measure 
(p) primarily dependent upon the distribution of abilities of the ar- 
bitrary population. Obviously, an element or task which can be ccr- 
rectly performed by p, per cent of a given population may be correct- 
ly performed by a higher percentage p. of another population with a 
higher mean. This dependence of a measure of difficulty on the para- 
meters of the distribution function of the population studied may not 
be escaped; difficulty is merely an obverse of achievement. When we 
say that a mental task is very difficult, for instance, we are merely 
expressing the fact that few individuals, of some group we have in 
mind, are capable of performing the task. If we use p (the percentage 
of passes) as a measure of difficulty of a test item, we understand 
that p is an average value; in fact p may be regarded as the average 
score of the group upon a test consisting of that one item. If we have 
a single task which has positive validity for the prediction of some 
criterion, and which may be unequivocally evaluated in terms of suc- 
cess or failure, we should have for each successively greater criterion 
value c; a corresponding greater percentage of passes p;. The rela- 
tion between p; and c; could be regarded as a discrimination function 
for the single item. 

However, there are various reasons for not using the single item 
for the present purpose. One reason is that a single item is subject 
to great fluctuations in response, i.e., it is unreliable. In the second 
place, the validity of most items is so low that item curves are com- 
paratively flat, and unrepresentative of the test discrimination func- 
tion. In the third place, the p value (average difficulty) of the single 
item is fixed and cannot be systematically varied. The discussion of 
the device adopted in the subsequent treatment will make clear the 
significance of this objection. In so far as a single objective item 
makes a prediction of the criterion, the distribution has a point char- 
acter. The record on the item, taken at its face value, makes a total 
of pN times qgN unit discriminations, where N is the population. In 
other words pN individuals are judged as better than qN other indi- 
viduals. The item behaves as if pqN? all-or-none judgments were 
made upon the abilities of individuals of the group.* 

Let us consider a test element to be sufficiently well represented 
by a limited number of items, homogeneous as to content and number 

*Obviously, the number of possible judgments on N individuals with respect 
to all others is 4%N(N-—1). Not all judgments are made by one item, and the 
maximum number of judgments is %4N2 which occurs when p—q=—.5. If we 
assume that item validity varies directly with the number of point discrimina- 


tions made by the item, then the item of 50 per cent difficulty is the most valid, 


other things being equal. 
Cf. Thurstone, Thelma Gwinn. “The Difficulty of a Test and Its Diagnostic 
Value,” Journal of Educational Psychology, 1932, 23, 335-43. 
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passing each. Furthermore, for convenience let the items each be 
passed by approximately 50 per cent of the population. These re- 
quirements are approximately satisfied by the fifty item test which 
has been designated as Test C. Although the test is to be considered 
as a unit, the constants of the distribution of scores on Test C and of 
its bivariate distribution against the criterion were computed for 
use in the subsequent analysis. The difficulty of this test element is 
now systematically varied by setting standards of difficulty at dif- 
ferent points in the distribution of scores on this fifty-item test. This 
makes possible, for each argument of difficulty, the description of the 
discrimination function in terms of parameters which have mean- 
ing in themselves, and in terms of the more generalized psychophysi- 
cal theory. In Figure 2 the bivariate distribution of the test element 


























FIGURE 2 


E and of the criterion C is represented in hypothetical terms. The 
means are M, and M, respectively. As a first approximation we 
assume linear regression, normal and homoscedastic E-arrays. In- 
spection of the obtained distribution suggests that this assumption 
is not unreasonable especially for values of E not too far from its 
mean. Let s, measured in standard deviation units from the mean of 
E, be the standard set for the difficulty of the test element, and con- 
stituting the operational determiner of difficulty of the element. One 
can express this difficulty of the element in terms of p, the percent- 
age passing, but this is not immediately useful. This latter form of 
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expression becomes possible by reason of the fact that element E is 
dichotomized at s. 

In Figure 2, the vertical line which contains the points K, L, and 
H represents any array in the bivariate distribution. The distribu- 
tion of scores on the test element in this array is represented by the 
normal curve shown in Figure 2. In this array, the proportion of the 
group, all having a criterion score of c who exceed the standard s 
is indicated by the cross hatched portion of the curve at the right. 
This proportion varies with c, and will now be expressed as a func- 
tion of c and the necessary parameters. 

Let the deviation score in the element be designated by e. 

Then the value of e corresponding to each c is given by the re- 
gression equation 

e=beec , (1) 


where b., is the coefficient of regression of e on c. For the array 
shown in Figure 2, ¢ is the distance LH. Since L denotes the location 
of the mean of the distribution of the array, the array score which 
just equals the standard is represented by KL. This distance we shall 
call a. The expression for the value of the standard in the array is 
then 
ee (2) 
Ca 

where o, is the standard deviation of tue array, and is assumed to be 
constant for all arrays. 

There will exist one array in which a = 0. This will occur when 
s = b..c. In this array, which can be represented by a vertical line 
passing through the point of intersection of the line of regression 
with the standard, the median array score just meets the standard. 
This point is M in Figure 2. We will now let the criterion score cor- 
responding to this array be represented by 


ie (3) 


ec 


Then d is the parameter to be used in describing the difficulty of test 
element E when the standard is s. The difficulty of a test element is 
defined as the standard score of the criterion measure at which the 
element (as a whole) is equally often passed and failed. 

Equation (2) may now be written, using the definition (3), 
thus: 


q— velé—*) (4) 


Cy 
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According to the hypothesis adopted there wiil exist for each 
array, a theoretical proportion meeting or exceeding the standard of 
difficulty. The observed proportions in the twenty-four arrays will 
not agree exactly with the theoretical proportions. We will assume, 
consistently with the theory thus far applied to the problem, that the 
integral of the normal probability curve may be used as the theoreti- 
cal curve. Clearly for a normal bivariate distribution, the proportions 
in the successive arrays vary with the corresponding criterion values 
exactly according to this function.* 


If in equation (4) we now substitute o; = i" we have 





win eee. (5) 


Od 


The theoretical proportions are represented by 


1 D 
aera de ’ (6) 


N (d-c)2 
=—=— C -_. - 
4 aa 2a 204? 
Following the usual procedure of minimizing the sum of the 
squares of the errors in the x (or base line) values corresponding to 
the proportions, we have as the expression to be minimized 


v= 3 (2), (7) 





where 





Cod 


the summation to extend over all arguments of the criterion for which 


corresponds to the theoretical, 





data are available. The term 


and the x to the observed proportions. The formal problem is now to 
find values of d and oz which will make this sum of squares a mini- 


mum. 
Differentiating equation (7) with respect to 1/o, and d/o, in 
turn, we have as normal equations 


*The assumption of normality and homoscedasticity of arrays is tantamount 
to the choice of the integral of the normal curve as the theoretical function. The 
curve fitting procedure will hereafter be described in outline only, since it is 
adequately treated in other applications, especially in the literature on the Con- 
stant Method in psychophysics. 

. See Kelley, Truman L. Statistical Method. New York: Macmillan Co., 1924. 
p. 326-30. 
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Sigs. Ey w Swed, (8) 
Od Od 
1 d 
—Swe——Swe—Swree=—0. (9) 
Od od 


The w’s in the equations are the usual weights used in the Con- 
stant Method. 
Solving (8) and (9) simultaneously, 


Dw: Swe? — (Swe)? 








i 10 
*~ Sw-DSwxe — DSwe- Swe ’ ate 
Swe - > wxe — Swe - Swe? 
~ Sw-Swree—Swxz-Swe — (11) 


Five degrees of difficulty were arbitrarily created by setting up 
various standards for passing the test element. These standards, and 
the computed values of o; and d, are presented in Table III. 


TABLE III. 


Parameters of Discrimination Function for Various Standards Subtest C 











Standard in score | Standard in ; Percentage | Index of Liminal 
Unitsofthe | Standard | of Passes | Validity Difficulty 
Element | Scores | p | oy d 
| | | | 
37.07 1.0 | 22.0 | 0.550 | 0.92 
31.59 | 0.5 | 34.6 | 0.412 | 0.34 
26.11 0.0 51.8 0.316 -0.05 
20.63 -0.5 64.9 | 0.317 —0.39 
15.14 —1.0 78.2 | 0.433 -.085 














This table shows the fairly close relation between the difficulty 
of the test element and the standard adopted for passing the element. 

In Figures 3 to 7 the observed proportions of each of the twenty- 
four criterion intervals who “pass” the element for the various stand- 
ards of difficulty are shown, with the theoretical curve fitted to each. 

The test element, with standard set to allow 51.8 per cent of 
passes, has a difficulty measure of —0.05, measured in the standard 
units of the criterion. Under these conditions the test element is most 
valid for discriminating between individuals at or near the mean of 
the criterion group. The element does not differentiate between the 
abilities of individuals in the highest 20 per cent of the criterion 
group. The same is true of the lowest 20 per cent of the group. Con- 
sidering that the region between the inflection points of the under- 
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lying normal curve is to be regarded as the practical limit of the ele- 
ment’s effectiveness, it can be said that a high validity element of 
this degree of difficulty is functional only between criterion scores of 
—0.370 to 0.27c. This is equivalent to saying that the element thus 
defined has validity for approximately the middle 25 per cent of the 
criterion group. 

When the difficulty of the test element is raised so that the limi- 
nal difficulty is 0.34 (percentage of passes is 34.6), the area of effec- 
tiveness is in the direction of higher criterion scores. The region be- 
tween one standard deviation above and below the liminal difficulty is 
defined by the limits 0.07c and 0.750, which includes approximately 
25 per cent of the criterion group. The measure of precision is the 
standard deviation of the theoretical curve. Its value is 0.412 in this 
case. When the standard of difficulty of the element is set at a still 
higher point, viz., 37.07 or 1c in the element variable, the element is 
functional in discriminating between individuals only in the upper 
half of the criterion group. This element has a difficulty such that 
practically none of those in the lower half of the criterion group are 
able to perform the task set. The greater o, indicates that it is a less 
valid measuring instrument for the purpose of separating those with 
criterion scores above le from those with scores below 1c, than is the 
same element for standards of difficulty which will divide the crite- 
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rion group at points nearer to the mean. Likewise, standards of dif- 
ficulty set for this element at points below the mean result in specific 
validity for a restricted sub-range of criterion ability, and practi- 
cally no validity for other sub-ranges of ability. Likewise the ele- 
ment predicts the criterion less well in general as the standard de- 
parts from a liminal difficulty of 0c. 


IV. RELATION TO COEFFICIENT OF VALIDITY 
In order to simplify equation (4), the substitution of o, for 
“* was made. This substitution was not arbitrary. We may write 


ec 


from ordinary correlation theory, 


Cg vi— Tec “We (12) 
and 
Dec = Tee — * (13) 
Cc 


Then we may rewrite (5) by substitution of (12) and (138), and 
simplify it to 


/1 on Foc 
5a (14) 


Tec 


when o, = 1. When (14) is solved for 7.,, we have 


1 
res go ° (15) 


Equation (15) gives us a method of estimating the validity co- 
efficient. In Table IV is presented the validity coefficients, as esti- 
mated by equation (15), and as directly computed. 

















TABLE IV 
Comparison of Measures of Validity of Elements of Varying Difficulty 
] Validity Coefficient 
Element | (1) As Estimated Standard 
from the (2) As Computed | Error 
Discrimination Directly | of (2) 
Function 
C; Standard: 1.00 0.876 0.896 | 0.0057 
C; Standard: 0.50 0.924 0.931 | 0.0088 
C; Standard: 0. ¢ 0.954 0.958 | 0.0024 
C; Standard :-0.5¢ 0.953 0.954 | 0.0026 
C; Standard :-1.00 0.918 0.941 0.0033 
D; Standard: Median | 0.892 0.902 | 0.0054 
| 
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It is seen from the table that the validity of a test element as 
estimated from the dispersion parameter of the discrimination curve 
is a fairly close approximation to the validity as computed in correla- 
tional terms. This indicates that the assumptions back of the ration- 
ale were fairly justified. Moreover, in situations where such validity 
coefficients are not available, they may be easily estimated from the 
precision parameter of the psychometric curve which we have called 
the discrimination function. 


V. DISCUSSION AND CONCLUSIONS 


1. Although not directed at precisely the same problem, the 
present investigation confirms the conclusion of Thelma Gwinn Thur- 
stone that a test composed of items of 50 per cent difficulty has a gen- 
eral validity which is higher than tests composed of items of any 
other degree of difficulty.* 

Her results, however, are not inconsistent with the hypothesis 
that a test or test element of a difficulty other than the optimum 
might have a satisfactory differential validity which is confined to 
specific intervals of the criterion measure. Thus a test or test ele- 
ment, while indubitably having only fair general or average validity, 
might conceivably be highly valid for differentiating between in- 
dividuals on some specified part of the criterion measure. The maxi- 
mum general validity of elements of 50 per cent difficulty might be 
easily interpreted in terms of a differential validity peculiar to each 
degree of difficulty. If we assume that each criterion score c can be 
best distinguished from adjacent scores by an element of difficulty 
d, each value of c being associated with an element of optimal difficul- 
ty d., then it is clear that when d = 0 (p = 50 per cent), the condition 
of maximum general validity is attained, since d = 0 is the best rep- 
resentative of a distribution (d,, d.,---d,) of different optimal diffi- 
culties for the various values of c. Any other value of d would pro- 
duce a greater average squared deviation from the respective optima 
for the various criterion scores. 


2. It is definitely established by these experiments that tests 
of different difficulty will predict to a two-categoried criterion with 
different degrees of effectiveness. If it is desired to separate off a 
minor proportion from the lower end of the distribution of criterion 
scores, then an easy test has much greater validity than have more 
difficult tests. Moreover, the smaller the minor proportion to be separ- 
ated from the criterion group at the lower end, the easier should the 
*Op. cit. 
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test be. The converse situation applies to minor proportious to be 
marked off from the upper end of the criterion group. It is to be 
noted, also, that if the general validity of a test can be regarded as 
a sort of average of the various differential validities, then its gen- 
era] or average validity decreases as the division point for the maxi- 
mal prediction into two categories departs from 0c, the mean of the 
distribution of criterion scores. 


3. The terms “differential validity” and “liminal difficulty” 
have been repeatedly used in this investigation. The term “differential 
validity” refers to the capacity of the measuring instrument in dis- 
criminating between various levels of ability. When the differential 
validity of a measuring device varies from one region or interval of 
ability to another, it becomes pertinent to inquire at what specific 
point this discriminative capacity is a maximum. The criterion score 
at this maximum we have defined as difficulty, or liminal difficulty. 
The term “liminal” is aptly used because of its close analogy to the 
limen of sensitivity found from psycho-physical experiments. The 
method of describing the test element as a discrimination function 
has at least two advantages. One advantage is that the same type of 
mathematical function can be used as in the conventional psycho- 
physical theory; a skew function can be easily adopted if the use of 
a third parameter is desirable by reason of small elements of extreme 
positive or negative degrees of difficulty. A more important advan- 
tage is that the parameters of the curve have meaning built into 
them by the manner of derivation. In fact, the meaning of the para- 
meters as used in the test setting have been expressed, to a fair ap- 
proximation, in terms of the customary measures of validity and 
difficulty. 

A further practical advantage of the method of measuring and 
expressing difficulty is that graphic methods are available. With the 
use of probability paper, the liminal difficulty of a test element and 
its validity may be quickly obtained. 

4. The procedures outlined in the foregoing definitely point 
to the unsatisfactory nature of the common practice in the construc- 
tion of tests of letting difficulty take care of itself. It is true that a 
test, no matter how the difficulty of its elements is distributed, will 
give a distribution of scores which may have practical usefulness. We 
cannot assume, however, unless the test is exceedingly long, that a 
chance distribution of difficulty will give scores which are linear with 
true measures of the ability. If, on the other hand, we have some 
specific purpose of prediction in mind, we may utilize the differential 
validities of test elements to our advantage. Suppose, for example, 


ar 


a... 
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that a test of clerical aptitude is meant to sort out the best 15 per 
cent of all applicants. This is on the assumption that the labor mar- 
ket is such that one hundred persons will apply for fifteen positions. 
It is then clear that the optimal difficulty of test elements should be 
in the neighborhood of -+1o and that easier tasks would give us 
discriminations between individuals in whom we are not interested. 
The proper choice of difficulty gives us the maximum discrimination 
between the applicants we care to consider seriously. The converse 
consideration would apply to any situation in which a minor propor- 
tion from the lower end of a distribution is to be separated off for 
any purpose. Under any circumstances involving educational or 
psychological measurement, the distribution of difficulty of the ele- 
ments or tasks can be arranged to fulfill more accurately the pur- 
poses of the measurement. 
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NOTE ON COMPUTATION OF BI-SERIAL CORRELATIONS IN 
ITEM EVALUATION 


JACK W. DUNLAP 


Fordham University, New York 


By the use of an algebraic variant of the ordinary formula for 
bi-serial correlation, tables, and graphic devices, a time-saving sys- 
tematic procedure for the computation of bi-serial correlation co- 
efficients is outlined for application to the evaluation of items of a 


test. A table of = for arguments of p = .000 to p = .999 is given. 


“ 


One of the most laborious steps in test construction is that of 
item validation. Various techniques have been presented for validat- 
ing items, one of which, the method of bi-serial correlation has at- 
tained considerable favor. A practical disadvantage of this method 
is that it is time consuming. The purpose of this paper is to outline 
a method which materially reduces the labor of computation when- 
ever it is necessary to compute many such correlation coefficients. 

The formula for the bi-serial correlation is usually written 


Mr—Mr pq 


Toi = . (1) 
Co « 
but can be rewritten in the form 
Mp—M,. 
vee . (2) 


where 
M; . p is the mean of the criterion scores for the total group; 
M> is the mean of the criterion scores for the group passing the 
item being studied ; 
or. p is the standard deviation of the criterion scores for the to- 
tal group; 
z is the ordinate corresponding to p. 
In formula (1) it is necessary to compute the mean criterion 
scores for those who pass the item and for those who fail the item. 
Therefore if we are determining validity coefficients for 500 items 


(which are scored right or wrong) it is necessary to compute 1000 
means. If the second formula is used it is necessary to determine 


= 
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only the mean score of all the subjects, and then for each item the 
mean criterion score of the subjects who succeed with the item. Thus, 
the computation of 500 means is eliminated. 

The following steps have been found economical in securing the 
necessary data for computing bi-serial correlations when Hollerith 
Tabulating equipment is not available. 


es 





On each test blank write the criterion score. This may be 
either the total score on the test of which the item is a part 
or a score from an independent criterion. 


The criterion scores should be expressed as 7 scores, thus 
simplifying the formula for 7 to 


M, — 50.0 p 
10 ; 


The subtraction M, — 50.0 may be done mentally and the di- 

vision consists sizaply of moving the decimal point one place 

to the left. Raw scores can be readily changed to T scores 

by a line graph which can easily be constructed. 

(a). In order to construct a line graph to change raw scores 
to T scores, we may write 


Ti = 


R 


: oo 
Pub oe. 
oC 
Rewriting to get the formula in a convenient linear 
form gives 
T= 50+ (10/0) X — (10/c)M or 
T=—a-+bX—k or 
T=A-+bX. 
(b). Suppose in a given problem that M == 82.64 and o = 
12.23, then 


T = 50+ (10/12.23) X — (10/12.23) (82.64) or 
T = .8177X — 20.52 . 


(c). Now take a sheet of graph paper and plot the equation. 
Paper ruled ten to the inch is quite convenient. Care 
should be taken to plot the points accurately and the 
line should be drawn in with a fine nibbed pen. It is 
convenient to plot T on the Y axis or ordinate and X 

on the abscissa. 











(d). 


(e). 
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As the equation is linear three points are sufficient 
to determine and verify the line. Two of the three 
points can be readily determined, for when X is set 
equal to zero, the T value is A, the constant, and when 
X is set equal to the mean, then T equals 50. 


After the line of the equation has been drawn, project 
the values written on the T and X axes to the line and 
label. (See Fig. 1.) The 7 values will appear on one 
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side of the line and the X values on the other, so that 
for a given value of X, T can be read directly. 

As a final check on the accuracy of the line graph 
determine two or three values by the graph and verify 
by calculation. If the chart is drawn reasonably care- 
fully the result will be read correctly to the first two 
places with a negligible error in the first decimal place. 


Using the line graph, express the criterion score for 
each blank as a T score. 


Sort the blanks into piles, each pile corresponding to a class 
interval. Suppose the range of criterion scores is 74, i.e., 
from 12 to 86, so that grouping by three’s we would have 25 
piles. The first pile should contain all papers whose criterion 
score falls between 12 to 14. 


Consider question No. 1. Go through the papers in the first 
pile. Here the class interval is 12-14. Count the number 
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who have correctly marked the question. Record this num- 
ber on the basic data sheet in column one opposite the class 
interval 12-14. (See the basic data sheet.) 

Now go through this pile of papers again and determine 
the number of papers on which question No. 2 was correctly 
marked. Record this number on the basic data sheet in col- 
umn 2 opposite the interval 12-14. In a similar manner de- 
termine the number of correct responses for each of the re- 
maining items and record in the appropriate column on the 
basic data sheet. 


Next analyze the papers in the pile 15-17 to determine the 
number of correct responses for each item. These values are 
placed in row two of the basic data sheet. Similarly analyze 
and record the number of successes for each of the several 
piles. When this is completed the data are available for com- 
puting the mean criterion score for the individuals who 
passed each item. 


The computation of the means can be expedited considerably 
by computing the sum of 7 or X’ values for two questions at 
atime. This is done by setting the two class frequencies in 
the keyboard of a calculating machine and multiplying by the 
X’ value assigned to that class. 


Record S X’ for the items in the designated blanks at the 
bottom of the page. Also record the value N, for each item, 
the number passing the item. 


Compute all the means keeping the results to one decimal 
place. Each of these means is the mean score for the sub- 
jects who passed a particular item. The value M, may be 
recorded in the line Mp, or what is more advisable do not re- 
cord Mp, but immediately subtract 50 and move the decimal 
point one place to the left. The result will be (Mp — M,) /o, 
or specifically, as T scores are being used, (Mp — 50) /10, 
and should be recorded in the space labeled (M, — Mr)/c. 
Hereafter this expression will be referred to as A. Note: In 
all cases where the item has a positive validity the value of 
M>, will exceed 50.0. Items which have a mean value less 
than 50.0 have negative validity and probably should be dis- 
carded, unless examination of the item shows that the scor- 
ing key is in error. 


Prepare a table or line graph giving the percentages for all 
values of Np/N where N;> is the number passing an item and 














10. 


11. 


12. 


13. 
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N is the total population. In case the percentage of successes 
for an item is less than 5 or greater than 95 the item prob- 
ably should be discarded due to the unreliability of these per- 
centages. 


Now by means of Table I determine the p/z value for each 
item. This may or may not be written on the basic data 
sheet at the option of the investigator. 


Set this value, »/z, in a calculating machine and multiply by 
the corresponding A value. The result is the desired bi-serial 
correlation and should be recorded. 


If it is desirable to weight the items, serviceable weights can 
be had by using the r values, first multiplying by ten to 
eliminate the decimals. 

A nomograph for determining 7 when p and (M,— M,)/oc 
or A is known, is given by the writer in this issue. This 
nomograph is sufficiently accurate for practicaily all pur- 
poses. 


In an investigation under the writer’s direction it was necessary 
to compute four bi-serial correlations (one for each of four possible 
responses to the item) for each of 870 items. The population used 
was 200. Thus it was necessary to compute 3480 correlations. The 
entire job was completed in ap, oximately 250 working hours, a 
rate of approximately 14 correlations an hour. 
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TABLE I 
TABLE OF p and p/z COMPUTED FROM THE KELLEY-WOOD TABLE* 
P 000 001 002 003 O04 005 006 007 +008 +009 P 


_— -2970 .8155 .38279 .3376 .3458 .8529 .3592 .3650 .3702 .00 
01 .38752 .3798 .3842 .3883 .3923 .38961 .3997 .4032 .4066 .4099 .01 
02 .4181 .4161 .4192 .4221 .4250 .4278 .4305 .4332 .4358 .4884 .02 
03 .4409 .4434 .4458 .4482 .4506 .4530 .4553 .4575 .4598 .4620 .03 
04 .4642 .4663 .4685 .4706 .4727 .4747 .4768 .4788 .4808 .4828 .04 


05 .4848 .4868 .4887 .4906 .4925 .4944 .4963 .4982 .5000 .5019 .05 
06 .5037 .5055 .5073 .5091 .5109 .5126 .5144 .5162 .5179 .5196 .06 
07 .5213 .5231 .5248 .5265 .5282 .5298 .5315 .5332 .53848 .5365 .07 
08 .5382 .5398 .5414 .5480 .5446 .5462 .5479 .5495 .5511 .5526 .08 
09 .5542 .5558 .5574 .5589 .5605 .5621 .5636 .5652 .5667 .5683 .09 


10 .5698 .5713 .5729 .5744 .5759 .5774 .5790 .5805 .5820 .5835 .10 
ll .5850 .5865 .5880 .5895 .5910 .5925 .5940 .5954 .5969 .5984 .11 
12 .5999 .6014 .6028 .6043 .6058 .6072 .6087 .6102 .6116 .6131 .12 
13 .6145 .6160 .6174 .6189 .6203 .6218 .6232 .6247 .6261 .6276 .13 
14 .6290 .6504 .6319 .63833 .6347 .6362 .6376 .6390 .6405 .6419 .14 


15 .64383 .6448 .6462 .6476 .6491 .6505 .6519 .6533 .6547 .6562 .15 
16 .6576 .6590 .6604 .6619 .6633 .6647 .6661 .6675 .6690 .6704 .16 
17 .6718 .6732 .6746 .6761 .6775 .6789 .6803 .6818 .6831 .6846 .17 
18 .6860 .6874 .6888 .6902 .6916 .6931 .6945 .6959 .6973 .6987 .18 
19 .7002 .7016 .7030 .7044 .7058 .7073 .7087 .7101 .7115 .7130 .19 


20 .7144 .7158 .7172 .7187 .7201 .7215 .7229 .7244 .7258 .7272 .20 
21.) .7287 + .73801 .7315 .73830 .7344 .73858 .7373 .7387 .7401 .7416 .21 
22.7430 .7444 .7459 .7473 .7488 .7502 .7517 .75381 .7546 .7560 .22 
23 .7575 .7589 .7604 .7618 .7633 .7647 .7662 .7676 .7691 .7706 .23 
24 .7720 .7735 .7749 .7764 .7779 .7794 .7808 .7823 .7838 .7852 .24 


25 .7867 .7882 .7897 .7912 .7926 .7941 .7956 .7971 .7986 .8001 .25 
.26 .8016 .8031 .8046 .8061 .8076 .8091 .8106 .8121 .8136 .8151 .26 
27 .8166 .8181 .8196 .8211 .8226 .8242 .8257 .8272 .8287 .8303 .27 
28 .8318 .8333 .8349 .8364 .8379 .8395 .8410 .8426 .8441 .8457 .28 
29 .8472 .8488 .8503 .8519 .8534 .8550 .8566 .8581 .8597 .8613 .29 


30 .8628 .8644 .8660 .8676 .8691 .8707 .8723 .8739 .8755 .8771 .30 
31 .8787 .8803 .8819 .8835 .8851 .8867 .8883 .8900 .8916 .8932 .31 
52 .8948 .8965 .8981 .8997 .9014 .9030 .9046 .9063 .9079 .9096 .32 
3 .9112 .9129 .9145 .9162 .9179 .9195 .9212 .9229 .9246 .9262 .33 
34 9279 .9296 .9313 .9330 .9347 .93864 .9381 .9398 .9415 .94382 .34 


235 9449 .9466 .9484 .9501 .9518 .9536 .9553 .9570 .9588 .9605 .35 
36 .9623 .9640 .9658 .9675 .9693 .9711 .9728 .9746 .9764 .9782 .36 
37 .9800 .9817 .9835 .9853 .9871 .9889 .9907 .9926 .9944 .9962 .37 
38 .9980 .9998 1.0017 1.0035 1.0053 1.0072 1.0090 1.0109 1.0128 1.0146 .38 
-39 1.0165 1.0183 1.0202 1.0221 1.0240 1.0259 1.0277 1.0296 1.0315 1.0334 .39 


.40 1.0353 1.0373 1.0392 1.0411 1.0430 1.0450 1.0469 1.0488 1.0508 1.0527 .40 
41 1.0547 1.0566 1.0586 1.0606 1.0625 1.0645 1.0665 1.0685 1.0705 1.0725 .41 
42 1.0745 1.0765 1.0785 1.0805 1.0825 1.0845 1.0866 1.0886 1.0906 1.0927 .42 
.43 1.0948 1.0968 1.0989 1.1009 1.1030 1.1051 1.1072 1.1093 1.1113 1.1134 .43 
44 1.1156 1.1177 1.1198 1.1219 1.1240 1.1262 1.1283 1.1305 1.1826 1.1348 .44 


45 1.1869 1.1391 1.1413 1.1484 1.1456 1.1478 1.1500 1.1522 1.1544 1.1567 .45 
46 1.1589 1.1611 1.1633 1.1656 1.1678 1.1701 1.1723 1.1746 1.1769 1.1792 .46 
7 1.1815 1.1838 1.1861 1.1884 1.1907 1.1930 1.1953 1.1976 1.2000 1.2023 .47 
48 1.2047 1.2071 1.2094 1.2118 1.2142 1.2166 1.2190 1.2214 1.2238 1.2262 .48 
49 1.2286 1.2311 1.2335 1.2360 1.2384 1.2409 1.2433 1.2458 1.2483 1.2508 .49 


*“The values in the table were computed by dividing the value for p by the 
value for z found in the Kelley-Wiood Table in Kelley, T. L., Statistical Method. 
The table was checked by differencing and again by a complete recomputation of 
the entire series.” 
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TABLE OF p AND p/z COMPUTED FROM THE KELLEY-WOOD TABLE 
Page two 


P 000 001 


50 1.2533 1.2558 
51 1.2788 1.2814 
52 1.3051 1.3078 
53 1.3323 1.3351 
54 1.3604 1.3633 


55 1.8896 1.3925 
56 1.4198 1.4229 
57 1.4512 1.4544 
58 1.4838 1.4871 
59 1.5177 1.5212 


60 1.5580 1.5566 
61 1.5899 1.5936 
62 1.6283 1.6323 
63 1.6686 1.6727 
64 1.7107 1.7150 


65 1.7549 1.7594 
66 1.8013 1.8060 
67 1.8501 1.8551 
68 1.9015 1.9068 
69 1.9558 1.9614 


70 2.01383 2.0192 
11 2.0742 2.0805 
72 2.1389 2.1456 
13 2.2078 2.2149 
‘14 2.2814 2.2890 


15 2.3601 2.3683 
‘16 2.4447 2.4535 
17 2.5358 2.5453 
‘18 2.6343 2.6446 
19 2.7411 2.7523 


80 2.8575 2.8698 
81 2.9849 2.9983 
82 3.1250 3.1398 
83 3.2799 3.2964 
84 3.4524 3.4707 


85 3.6456 3.6662 
86 3.8638 3.8872 
87 4.1126 4.1394 
88 4.3991 4.4302 
89 4.7331 4.7697 


90 5.1283 5.1718 
91 5.6088 5.6567 
92 6.1884 6.2543 
93 6.9264 7.0112 
94 7.8910 8.0042 


95 9.2111 9.8708 


98 20.2404 21.1632 22.1831 23.3159 24.5828 26.0100 27.6291 29.484 
99 37.1454 40.7718 45.2555 50.9570 58.4603 68.8105 84.0719 108.9737 157.4132 296. 7033 . 


002 


1.2583 
1.2840 
1.3105 
1.3378 
1.3662 


1.3955 
1.4260 
1.4576 
1.4905 
1.5246 


1.5603 
1.5974 
1.6362 
1.6768 
1.7194 


1.7640 
1.8108 
1.8601 
1.9121 
1.9670 


2.0252 
2.0868 
2.1523 
2.2221 
2.2967 


2.3766 
2.4624 
2.5549 
2.6550 
2.7636 


2.8821 
3.0118 
3.1547 
3.3129 
3.4892 


8.6871 
3.9109 
4.1666 
4.4618 
4.8068 


5.2162 
5.7108 
6.3219 
7.0982 
8.1210 


9.5366 


003 


1.2609 
1.2866 
1.3131 
1.3406 
1.3691 


1.3985 
1.4291 
1.4608 
1.4988 
1.5281 


1.5639 
1.6012 
1.6402 
1.6810 
1.7237 


1.7685 
1.8156 
1.8652 
1.9175 
1.9727 


2.0312 
2.0932 
2.1591 
2.2294 
2.3044 


2.3849 
2.4713 
2.5646 
2.6654 
2.7750 


2.8945 
3.0255 
3.1698 
3.3297 
8.5080 


3.7082 
3.9350 
4.1942 
4.4938 
4.8445 


5.2614 
5.7661 
6.3911 
7.1876 
8.2416 


9.7089 


004 


1.2634 
1.2892 
1.3159 
1.3434 
1.3720 


1.4015 
1.4322 
1.4641 
1.4972 
1.5317 


1.5676 
1.6051 
1.6442 
1.6852 
1.7281 


1.7731 
1.8205 
1.8703 
1.9229 
1.9784 


2.0372 
2.0996 
2.1659 
2.2366 
2.3122 


2.3932 
2.4803 
2.5743 
2.6760 
2.7865 


2.9071 
3.0393 
3.1851 
3.3466 
3.5269 


3.7296 
3.9593 
4.2222 
4.5264 
4.8829 


5.8075 
5.8225 
6.4619 


005 


1.2659 
1.2918 
1.3186 
1.3462 
1.3749 


1.4045 
1.4353 
1.4673 
1.5006 
1.5352 


1.5713 
1.6089 
1.6482 
1.6894 
1.7325 


1.7778 
1.8253 
1.8754 
1.9283 
1.9841 


2.0433 
2.1060 
2.1728 
2.2440 
2.3201 


2.4017 
2.4894 
2.5841 
2.6866 
2.7981 


2.9197 
3.0532 
3.2005 
3.3638 
3.5461 


8.7513 
3.9840 
4.2506 
4.5595 
4.9220 


5.3545 
5.8801 
6.5346 
7.3742 
8.4950 


006 


1.2685 
1.2945 
1.3213 
1.3490 
1.3778 


1.4076 
1.4385 
1.4706 
1.5040 
1.5387 


1.5749 
1.6128 
1.6523 
1.6936 
1.7369 


1.7824 
1.8302 
1.8806 
1.9337 
1.9899 


2.0494 
2.1125 
2.1797 
2.2514 
2.3280 


2.4102 
2.4986 
2.5940 
2.6973 
2.8097 


2.9325 


9.8884 10.0752 10.2701 
96 11.1408 11.3840 11.6396 11.9083 12.1910 12.4887 12.8028 
97 14.2559 14.6779 15.1284 15.6100 16.1266 16.6824 17.2817 


007 


1.2711 
1.2971 
1.3240 
1.3519 
1.3807 


1.4106 
1.4416 
1.4739 
1.5074 
1.5423 


1.5786 
1.6166 
1.6563 
1.6978 
1.7414 


1.7871 
1.8352 
1.8858 
1.9392 
1.9957 


2.0555 
2.1191 
2.1867 
2.2588 
2.3359 


2.4187 
2.5078 
2.6039 
2.7081 
2.8215 


2.9454 
3.0815 
3.2318 
3.3986 
3.5852 


8.7954 
4.0344 
4.3087 
4.6272 
5.0023 


5.4512 
5.9993 
6.6853 
7.5717 
8.7663 


10.4733 
13.1350 
17.9299 


7 31.632 


008 


1.2736 
1.2998 
1.3268 
1.3547 
1.3837 


1.4137 
1.4448 
1.4772 
1.5108 
1.5458 


1.5824 
1.6205 
1.6604 
1.7021 
1.7459 


1.7918 
1.8401 
1.8910 
1.9447 
2.0015 


2.0617 
2.1256 
2.1937 
2.2663 
2.3440 


2.4273 
2.5171 
2.6140 
2.7191 
2.8334 


2.9585 
3.0959 
8.2476 
3.4163 
3.6051 


3.8179 
4.0601 
4.3384 
4.6620 
5.0435 


5.5010 
6.0609 
6.7636 
7.6749 
8.9093 


10.6858 
13.4866 
18. om ot 


009 


1.2762 . 
1.3024 . 
1.3295 . 
1.3576 . 
1.3866 . 


1.4167 . 
1.4480 . 
1.4805 . 
1.5142 . 
1.5494 . 


1.5861 . 
1.6244 . 
1.6645 . 
1.7064 . 
1.7503 . 


1.7965 . 
1.8451 . 
1.8962 . 
1.9503 . 
2.0074 . 


2.0679 . 
2.1322 . 
2.2007 . 
2.2738 . 
2.3520 . 


2.4360 . 
2.5264 . 
2.6241 . 
2.7300 . 
2.8454 . 


2.9716 . 
3.1104 . 
3.2637 . 
3.4842 . 
3.6252 . 


3.8407 . 
4.0862 . 
4.3685 . 
4.6973 . 
5.0855 . 


5.5519 . 
6.1239 . 
6.8440 . 
7.7813 . 
9.0574 . 


10.9078 . 
13.8597 . 
19.4007 . 

4.1506 . 
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TABLE II 


Basic data sheet for bi-serial correlations in item analysis 



















































































































1 Pak eee 
Sen item — 
Class _x|1fels|«]se |r) s/o [w/a | a 
84-86 | 24 || | | | |_| | 
81-83 23 || cee | ie a 
78-80 fee j | | Lest eee oe Teer 
75-77 21 | | | | 
| || >a 
24-26 4 j27/15,10) | | | Vi ey Te ae, ee 
21-25 Me ss! Ned ack i ee oe Fem ae CB 
18-20 |_2 oe ee oe ee 
15-17 a 4 Kad Bei te 2o: ae ae Se Ok 
12-14 Bie isi ss | 7. [= ed nee Weare 
Np rT ee ee ea ee Oe 
SPS AEE ei hee ee ee 
(M,—M,)/o | hans Dee eee ae Rae Cae 
SS PERE SER ESS 
p/z | i” bale - am Coe = a ae 
| | 
r | | | | | | | | 












distribution. 


Note that N, M, and ¢, (¢) are constant for all items based on the total 
































PSYCHOMETRIKA—VOL. 1, NO. 2 
JUNE, 1936 


NOMOGRAPH FOR COMPUTING BI-SERIAL CORRELATIONS 


JACK W. DUNLAP 


Fordham University 


The widespread use of bi-serial 7 in item analysis makes a quick 
and accurate method of evaluating the formula desirable. Such a 
method is provided by nomographs. Dunlap and Kurtz* in their 
Nomograph No. 47 give a method of solving the better known state- 
ment of the formula, namely 


M,—Ma 9q_ 
o z 


(1) 


hei 


As the writer has shown elsewhere in this Journal a form more 
convenient for solution in problems of item analysis is 


pon i 
o 2 


(2) 


Ti — 


The nomograph for the solution of this expression together with 
the directions for using the nomograph are given on the next page. 


*Dunlap, Jack W. and Kurtz, Albert K., Handbook of Statistical Nomo- 
graphs, Tables, and Formulas. World Book Co. 1932, Yonkers, New York. 
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1); = Bi-serial correlation 

p= Per cent in category 

M,= Mean of Category 

M, = Mean of total distribution 

oy = Standard deviation of total distribution. 


To Use the Nomograph: 

Find the values for (MV, — M,,)/gp and p on the 
(M, — M,)/*, and p scales. Connect these points by 
means of a straight-edge, thread, or straight line 
etched on a piece of celluloid and read the value for 
bi-serial , where the line cuts the 7 scale. 
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